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H»ACB 


This  study  is  a  contribution  to  research  conducted  by  The  RAND 
Corporation  in  the  field  of  game  theory.  The  formulation  presented 
in  this  MeisoranduB  has  theoretical  application  in  both  military  and 
civilian  situations  where  searcher  and  evader  tactics  are  involved. 
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SUIftlARY 

The  solution  of  the  follcwing  hide  end  seek  game  is  presented: 

At  each  move  Player  I,  the  evader,  is  allied  to  hide  in  one  room, 
while  Player  II,  the  searcher,  is  allowed  to  search  some  given  number 
of  rooms.  The  restriction  is  made  that  Player  II  searches  without 
repetition,  that  is,  he  is  never  allowed  to  return  to  a  room  he  has 

previously  searched.  It  is  shown  that  if  the  payoff  to  Player  I  is 

\ 

any  increasing  function  of  the  number  of  moves  "before  capture,  his 

strategy  is  also  never  to  return  to  a  room  in  which  he  has  previously 
hidden.  A  formula  for  the  value  of  the  game  is  presented. 
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The  comnon  situation  of  search  versus  evasion  can  be  described 
precisely  in  the  language  of  game  theory:  Player  1,  the  evader,  and 
Player  11,  the  searcher,  each  choose  an  integer  from  1  through  N  (each 
integer  representing  one  of  N  separate  rooms).  This  process  is  repeated 
until  either  a  match  occurs  (i*e,,  II  finds  I)  or  the  game  has  run  some 
preselected  number  n  of  moves.  In  the  first  case  there  is  no  payoff, 
while  in  the  second  case  II  pays  I  one  unit.  If  no  restrictions  are 
placed  on  the  strategies  of  the  players  the  solution  of  this  game  is 
trivlal--each  player  chooses  randomly  with  equal  probability  from  the 
coBiplete  set  (1,  2,  ...  M}  at  each  move,  and  the  value  of  the  game  is 

This  paper  investigates  the  solution  of  the  same  game  under  the 
restriction  that  II 's  search  be  systematic--after  Player  II  visits  a 
room  he  may  not  return  to  that  room  until  he  has  searched  through  the 
M-l  others.  It  is  natural  in  this  case  to  insist  that  n  be  equal  to  or 
less  than  M.  II 's  possible  pure  strategies  are  represented  by  the  per- 
snitations  of  n  out  of  the  N  Integers.  (A  permutation  is  defined  as  an  ordered 
set  without  repetition.)  From  the  symmetry  it  is  easily  seen  that  II' s 
optimimi  strategy  is  to  choose  the  [N]^  «(M)(N-l)(N-2)... 

(H  -  n  +  1)  penmitations  randomly  and  with  equal  probability. 

The  main  result  of  this  paper  is  a  proof  that  under  these  circum¬ 
stances  I's  optimma  strategy  Is  exactly  the  sane  as  II' s;  I  randomly 
diooses  n  different  integers,  never  making  use  of  his  option  to  return 
to  a  room  he  has  alreddy  visited.  A  simple  expression  for  the  value  of 
the  game  is  derived,  also  yielding  the  expected  payoff  for  any  other 
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strategy  Player  1  may  choone.  Ihe  theorems  are  actually  proved  in  much 
greater  generality— when  II  la  allowed  to  search  more  than  one  room  per 
move,  when  the  payoff  to  I  Is  any  Increasing  function  of  his  survival 
time,  and  conditionally,  when  for  any  reason  another  rule  has  been 
followed  up  to  a  certain  point.  Ihe  universality  of  the  "no  return 
rule"  is  of  course  very  useful  to  Player  I,  who  can  play  optimally  %rith 
practically  no  information  on  the  actual  structure  of  the  game. 

The  condition  of  systematic  search  is  often  encountered  in  practice, 
either  because  of  ignorance,  physical  inconvenience,  or  ulterior  motives 
on  the  searcher's  part.  The  watchman,  the  detective,  and  the  air  recon¬ 
naissance  team  anxious  to  cover  as  much  ground  as  possible  are  all  likely 
to  search  non- repetitively.  If  the  evader  has  no  additional  information 
on  the  searcher's  pattern,  then  it  is  sensible  for  him  to  play  the  "no 
return  rule".  For  in  this  case  the  searcher's  optimum  strategy,  all 
permutations  equally  likely,  coincides  with  the  natural  "ignorance" 
distribution. 

FOHHAL  PEFINITIOMS  AHD  A  SIATEMPTT  OP  THE  THEOBEKS 

In  the  most  general  situation  discussed  in  this  paper  Player  II 
will  be  allowed  to  search  rooms  on  his  first  move,  M2  on  the  second, 
...  and  on  the  nth,  where  the  are  fixed  constants  such  that 

+  M2...  +  M^  s  Nq  i  H. 

(He  searches  without  repetition,  as  explained  in  the  introduction.) 

Player  1  is  allowed  to  hide  in  only  one  room  per  move  but  he  may  return 
to  rooms  he  has  already  visited  if  he  so  desires.  If  Player  II  first 
finds  Player  I  on  the  j^th  move,  I  receives  a  payoff  of  P(j^)  units, 
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(Pnfl)  btlng  the  payoff  If  no  detection  occurs i  P(l)  u:  P(2)  P(nrH), 
Formally  we  denote  II 's  selection  different  rooms  by 

(ril.  ^12  •••  ...  ...  ...  ^ 

•a  permutation  of  size  *  ^1  ^  ^2  ' *  *  ^  ^n  first  N  positive 

integers.  Player  I  selects  an  n-tuple 


(Rl,  Rn 


R  ) 

n' 


from  the  first  K  positive  integers,  repetitions  being  allowed.  is 
Player  I*s  hiding  place  and  ...  r^^)  the  rooms  searched  on 


the  jth  move.  If  is  th^  smallest  value  of  J  such  that 


R,  e  fr  ,  r 

J  ^  jr  j2 


r  ] 

Jm/ 


Player  II  pays  Player  I  PCj^)  units.  If  there  is  no  such  value  of  j, 

I  receives  P(n*fl)  units,  where  the  P(J)  form  a  non-decreasing  sequence. 
This  situation  will  be  referred  to  as  the  general  case. 

When 

M,  -  -  M  *  M 

12  3  n 


and 

P(l)  -  P(2)  ...  -  P(n)  -  0 

P(n+1)  -  1, 

we  shall  say  we  are  in  the  special  case.  (The  special  case  with  M  ■  1 

the  game  discussed  in  the  second  paragraph  of  the  introduction.) 

Assume  first  that  Player  II  plays  ''random  permutations,"  that  is 

II  chooses  among  the  Ck]||  possible  permutations  randomly  and  with 

"O 


4- 


•fual  probcblllt^f .  The  aMln  concluelon  of  this  paper  le  that  Tlayer  I's 
best  eouater-atratagy  la  then  alao  to  play  random  permutations;  Player  X 
selects  the  n-tuple  (R^,R2«>.R^)  randomly  and  with  equal  probability  from 
the  possible  permutations  of  n  out  of  the  M  integers.  But  when  X 
plays  In  this  manner »  at^  strategy  II  may  choose  yields  the  same  eicpected 
payoff  p  which  Implies  that  random  permutations  is  the  optimum  strategy 
for  both  players.  In  the  sequel  it  is  always  assumed  that  Plaver  II . 
but  not  necessarily  Player  I.  behaves  in  this  way. 

Define  R(n^pn2«  •  sn^^)  as  the  set  of  n-tuples  (R^pR^.e-R^)  involving 

k  distinct  integers  with  frequencies  n^,n2p . respectively,  where 

necessarily 

n,+n^+. . . .n  •  n 
12  k 

Each  eleomnt  of  R(n^,n2s * • *0^)  is  a  pure  strategy  for  Player  I.  It  is 

important  to  note  that  in  the  special  case,  all  of  these  pure  strategies 
(and  hence  any  probabilistic  mixture  of  them)  give  Player  I  the  same  pro¬ 
bability  of  escaping  detection  for  the  duration  of  the  game  when  Player 
II  is  playing  random  permutations.  We  denote  this  probability  by 

pn2  •  • 

For  convenience  we  call  the  set  of  all  mixed  strategies  for  Player  I 
involving  only  the  elements  of  RCn^pO^. . .n^)  *'tke  stratear  ^  •••  n|^)" 

(or,  if  mo  eottfualon  is  poaslbla,  sii^ly  stratogy  !**•)  Thm 

?(nj^pn2...n^)  ■  ▼(•) 

is  the  expected  payoff  versus  random  permutations  of  strategy 
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SCa^^n^.-.n^)  ■  S 


in  the  special  case. 


(As  a  specific  eacample  of  these  definitions  let  N^,  n"3»  n^«l» 
02*2.  Then  (R^,R2.R3)  -  (2,7,7)  and  (R^,R2,R3)  -  (3,5,3)  are  both 
elements  of  R(n^,n2).  The  pure  strategy  for  player  I  "room  2  first 
move,  room  7  second  move,  room  7  third  move"  Is  a  member  of  S(n^,n2), 

as  Is  the  mixed  strategy  "20X  of  the  time  room  2  on  the  first  move, 
room  7  on  the  second,  room  7  on  the  third;  80X  of  the  time  room  3  on 
the  first  move,  room  5  on  the  second,  room  3  on  the  third.") 

For  the  purpose  of  evaluating  V(n^,n2«  • .  •Uj^)  we  can  use  any  ele¬ 
ment  of  R(n^,n2...nj^)  to  realize  S(n^,n2. .  .n^)  .  A  particularly  useful 


choice  will  be 


(R2,R2  • • *  (  1 , 1 ,>>*«» 1 ,  2,2, . *2 , 


.k,k, . k  ) 


Given 


8  m  8(n2  >^2  *  *  *  *  *^m*  *^St^  * 

where  n^  <  n^. 


the  two  strategies 


S*  m  8(nj,ii2...n^.l,nb  +  l*Vr  ’ '  VrV^'Vr  * '“k) 

8*  ■  8(nj,n2...nj^...n^.l,n^-l,n^...  iijj,  1) 


arc  both  aaid  to  be 


from  8.  *2  derived  fron  8^^  if 


It  can  be  ettetned  froa  8^  by  e  aequence  of  staple  derivations. 

Theorea  1  (special  case) :  X£  82  is  derived  froa  8^  then  V(82)  >  V(82) < 
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Among  all  strategies  S(nj^,n2. .  .n^^)  such  that  ...  +  ■  n,  the 

••tio  return”  rule  Sg  S(l»l. .  .1)  maximizes  V(S)  • 

n 


Define 

s'  (n',  n'  ... 

nj^/)  -<S(nj,  iij.. 

if 

k'<  k 

and 

1-1 

c 

VI 

1  -  1,2  ...  k'  . 

A  representative  realization  of  S  Is  the  pennutatlon 


V"“k'  V+1 


which  shows  that  Flayer  I  may  think  of  playing  strategy  first  and  then. 
If  he  Is  not  detected  by  Player  II,  completing  It  to  strategy  S.  The  con¬ 
ditional  probability  that  Player  I  will  escape  detection  playing  strategy 
S,  given  that  he  has  already  played  S'  without  detection  is  defined  as 
V(S  I  S').  (A  formal  definition  of  the  conditional  expectation  is  post¬ 
poned  until  the  next  section.) 


Theorem  2  (special  case):  Suppose  S^,  ^2  <lorived 

from  Sj^.  Then  VCS^I  S^)>  V(Sj^  |  S^) .  Given  any  strategy  S^  •  S(nJ^, 


where 


+  n^  +  .. .  +n^f  g  n'  <  n, 

Let  8^  -  S  (n',  n^,...n^  M,  1). 

n  -  n' 

Then  V(S^  I  ^  I  ^o^  among  all  strategies  8(n^,a2» • . .n|^)  such 

that  ^  8  and  n^^  ♦  n2  ....  ♦  n^  ■  n.  (In  other  words,  Player  I  should 


begin  playing  the  "no  return  rule”  as  soon  as  he  is  allowed  to  do  so.) 
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Given  strategy  8(nj^,n2, . .  .n^^) ,  define 

I 

1-1 

k-1  k 

”2  ■  I  Z  Vj 

1-1  J-t+1 

‘^k*  V2--V 

(the  ere  the  elementary  eymetric  functions  of  n^gn2«  • -ni^*) 
Value  Theorem  (Special  Case) 

Mo,  ^<^2  <-*‘)\ 

V(ni,n2...v.^)-1-  ^ 

In  particular  for 


h-0 


uhtch  is  the  value  of  the  gasie  (attained  iihen  both  players  play  random 
permutations ») 

Iheorf  3  (Eneral  case) 

landom  permutations  is  the  optimum  strategy  for  both  players  ♦ 
liore  elaborate  results  are  obtainable  in  the  feneral  case^  but  th^ 
will  not  be  investigated  here.  It  should  be  noted  that  theorem  3  holds 
true  regardless  of  the  constants  hence  they  need  not  be 

assumed  knoim  to  Flayer  I. 


The  second  helves  of  Theorems  1  end  2  ere  sli^le  consequences  of 
the  first  stetements.  To  prove  these  it  Is  sufficient  to  consider  only 


the  subcese  M  ■  since  the  stretegy 

S  ■  8(nj,  •••  “if) 

for  generel  M  is  equivelent  to  the  stretegy 

S  ■  S(nj^M,  n^N,  • . •  n^M) 

for  M  ■  1.  Furthermore »  using  the  obvious  notetion,  if  $2  is  derived 

*  *  *  m 

from  8^  then  8^  is  derived  from  end  if  then  <  8  . 

In  the  speciel  subcese  with  M  ■  1  we  ehenge  notetion  slightly  end 
denote  Fleyer  II 's  rendomly  selected  peneutetion  by 

(r<l),  r(2)  ...  r(n)). 

M  coHMuCed  prcvlooaly,  a  atratagy  8(nj^ ,82 . .  .Uj^)  for  Playar  1  can  ba 
raallaad  by  tha  n>tiipla 

“1  “2  "k 

Daflna 

i-1  1-1  1-1 

A^«|r(l-f  ^  Oj),  r(2+  ^  n^)  ...r(nj^  +  ^  Uj)}  1  •  1,2. 

J-1  J-1  J-1 

^1  “  *  1  >  k. 

la  tha  aat  of  rooaa  Playar  11  aaarebaa  lAlla  Playar  1  la  hiding  In 

rooBi  1  undar  tha  atratagy  nbova.  la  lAat  follows  It  la 

asaiaad  that  1  plqra  thla  flnad  pora  atratagy,  shlla  IX  pl^a  randon 
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pensutatlona .  Then  the  sets  ere  functions  of  the  rsndoa  peissitetlon 
(r(l),  r(2), . r(n)  ),  end  the  event  of  no  capture, 

r(j)  ^  J  -  1.  2. . n 


Is  equivalent  to  the  event 


I  f  1  -  1,2  ...  k. 


Main 


Ut  p^  -  P(h  s  W  I  t  ^  Aj^,  1  -  1,2  ...  k) 

h  -  1,2  ...  H. 

Th«n  if  k  a2  k  •••  2  ^  * 

Pl<P2  1  •••  -**W-1  “  Plc« . Pn* 

Froof:  Smt  ^  *  0  for  h  >  k  and  auppoao  that  for  som  m  and  h,  >  n^. 
Daflna 

•  '{'»*  '<”•  jli  "j>  •••  A  ♦  ”i>} 


•  A^  ,  1  #  «. 

Then 

P,,  .  P(1  #  A^  1  -  1,2  ...  k)  - 

-  P(h  «  B,  ■  ^  B,  1  ^  A^  1-1,2  ...  k) 

k 

<»>  f(h  M,  ■  ^  B,  h  «  0  I.,  1  <  I.  i  -  1,2  ...  k) 

1-1  *•  * 
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Pm  •  P(1  ^  \  1  -  1,2  ...  k) 

•  ^ 

-  P(h  ,  B,  m  ^  B,  i  Aj  1  -  l,2...k,  m  e  U  A  ) 

k  • 

+  P(h  ^  B,  m  ^  B,  m  ,  U  A  ,  i  ^  A,  1  -  1.2  ...  k). 

1-1  I  1 

The  second  terms  on  the  right  sides  of  these  two  equations  are  equal  by 
symmetry,  and  comparing  the  first  terms  verifies  the  lemma* 

Given 

*<  s(n^,  nj  ...  Oj^) 

define 

i-1  i-1  i-1 

Aj  -{r(l+  ^  Dj),  r(2+  ^  n^)  ...  r(n' +  n^)}  t  ■  1,2  ...k^. 

J-1  J-1  j-1 

Th«  value  and  conditional  value  are  foxaally  defined  by 

V(S)  5V(nj  ...  n^)  a  P(i  ^  A^  ,  1  -  1,2  ...  k) 

V<8  I  s')  a  P(1  ^  A^,  1  -  1,2  ...  k  I  1  f  aJ  1  -  1,2  ...  k'). 

Finally,  for  "xy  Miual  aero),  let 

8q3  S(n^,n2  ...  n^^  ...  n^-1  •••  “i^) 

8j^  a  S(n^  ,n2  ...  n|^  ...  n^  ...  i^) 

8^  a  8(0^  ,3^  ...  +  1  •  •  •  “b  '  ■  *  “k^ ' 

^**2  I  ^^^*1  I  V- 

Proof;  veSj  (  8^)  -  1  -  (I  -  p^) 

H  -  n  +  1 

V(S2  I  8o>  “  1  -  Ph> 


M  -  n  +  1  • 
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Applying  th«  Icoow  provi*  th«  corollary. 

Proof  of  Thoorwat  1  and  2 

implying  the  definitions,  If  ‘K  S  then 

V(S)  -  V(s')  V(S  )  s'). 

Thus  the  corollary  Impllea  that  V(S2)  >  V(S^)>  and  Iterating  thla  reault 
proves  Theorem  1.  The  equality  above  also  ahowa  that  Theorem  1  implies 
Theorem  2. 

Define 

5  {(r(l),  r(2)  ...  r(n)) |  1  «  }  1  -  1,2  ...  k 

(the  elements  of  T^  are  permutations  of  sise  n  from  the  first  M  positive 
integers)  so  that  the  event 

i  ^  i  -  1,2  ...  k 

is  equivalent  to  the  event  ^ 

(r(l).  r(2)  ...  r(n))  ^  U  T.  . 

i-1  ^ 


By  direct  evaluation 


P(T^ 


1 


Applying  a  well-knom  fomiula^^^  ylald.  th.  value  thaorws  for  N  ■  1, 
and  the  renark  at  the  beginning  of  this  section  extends  the  result 
to  general  M. 

In  the  general  ease  let  (R^«  ^2  •••  *<>y  eleMnt  of 

R(nj^,  n^  ...  f  ■  any  Integer  that  appears  aore  than  ones  in 
(Ej^t  R2  ...  R^)t  and  h  the  largest  integer  such  diat 


*h“" 
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It  Is  a  slmpla  conssquancs  o£  the  main  lemma  that  the  n-tuple 

(Rj,  ...  Rj(,  ... 

yields  a  greater  expected  payoff  than  (R^i  1^2  ***  versus  random 
pemutatlons  whenever 


*h  ^  {^1*  *2  •••  *n}  * 


Theorem  3  follows  by  induction 
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